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LETTER OF TRANSMITTAL 



House op Representatives, 
/ Washington, DC, October 8, 1986. 

Hon: Thomas P. O'Neux, Jr., 

Speaker of the House of Representatives, 

Washington, DC. 

Dear Mk: Speaker: By direction of the Committee on Govem- 
;ment Operations, I submit herewith the committee's sixtieth report 
rto the 99th C!ongress. The committee's report is based on a study 

made by its Intergovernmental Relations and Human Reisources 

Subcommittee. 

Jack Brooks, Chairman. 
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' V^^:";™ LIMITS ON 



':KvpcTOBE^^ the Committee of the Whole House on the State of 

: ^ the Union cmd ordered t^ be printed 



ii* ' J ■ : ■ on Goyernm^^^ :'subinitted,.the following 

: BY THE iNTERGOVlilNMEan'AL ReIATION^ AND 

f :!; '.-.I/r ; v HuMAN ^Resources Subto ; . ■ " ' v>> . ■ ■ . ^ 

f ; ; On -Septe 

g atioii^ approved an adopted a V^pgrt entitled "The Department of 
%Education'SjIiimti3;pn^'P^ 

:>^VTnbe chaiim Speaker of 



^I. iNTOODUCrnON : 



; : of Representatives Rule X, 2(bX2), the Conunit- 

; ;tee on Govei^ and study, 

: { on a cbntin^ the| pperationrof Government^^^^^^^ at s31 

^ levels : with , a view tb| determining their economy and efficiency/' 
>; The c^ responsibility, as it pertains to the 

j:r l)epaftment of .Education^ Siibconiihittee, on Intergovemmen- 



• j JE^ra^^^ subconuniibtiBe. conducted an over- 

i sight , investiga^^ the ; Department of Education's Publication 
Cand'^^Audio Visual Advisory Council (PAVAC). PAVAC was created 
by the Department in 1982 as a response to a 1981 Directive of the 
Office. of Management; and Budget (OMB). PAVAC's mandate was 



to: re\dewifall^ pubUciations : an^ order ^to'save 

money i byieliminatingtm costs aasociated with the print- 

ing and production of written an^ 

: Starting in 1982,vPAyAC reviewed m&y pubUcatioM : 
essentially public infbnnation brochiires^ b it also reviewed publi- 
cations arid i products ;^^desigried v to d^ tech-v 
niquiM and ii&r^^ 
countiy^S m; 8^^^ 

^ handicapi^;^bilHgu^ 

began tq: alk)* review more' gehercU,^^^ which 
were developed :: to^disseminate the ^ resiilts of reisearch :and pro- 
grams fimded through the^N^ Education (NDS). : 

of the • propor- 
tion and- ty^:*bf. publications ^^^^^ 

and ' disapproved/ the^ costs fa^ well as - the 

direct arid indirect iiiH)a^ 

tion of educatioriial information. On November 5; 1985; fi^^ ■ 
after the subcomniittee notified the ?5^0r(ment of its ^investiga-; 
tiori/ PAVAC was) replaced by^ th^ 

(PRB); CdmparisoM^^ of 
any change«,'iare alsd^ included in the subcominittee iriq YJ" 
: %Ori Noveriiberi 13, 1985,: the subcommittee; h^ld a hearing, which 
included' testinibny from- th Chair of PAVAC, this; Vice Chair of , 
PAVAC who had just become the Chair of PRB, the senior staff as- 
sistant for I^^yAC;^dPRBi)the^^ 

west R^^onal Educational Director of the 

; National - Institute v^of VEdriratibrifl'the » fbhn^^ Director ^ of ^ the 
• Women's Educational Equity ; Act : Ptbgram; ■ the [ Presidentelect ^ of 
the v 'Ariiericari the ( Washington 

repriwentative : ofl and the 

Chairmaii of Pedple fbr the^AiriiBri^^ ■ ; ^ : : • ^ 

Additional infoimati^^^^ by; the 

Assistant Secretary- for Eleineritary Secondary :Education,':the . 
c OfBce of tiie Geriera^^^ 

DirecH^ra^iand other' i^^^^^ lliregibncd educa- 

tional laboratories and national research centers, and others direct- 
ly and indirectly involved in the PAVAC reyiisw process. 

; .When the Departriient of Ediicatibri^^^^ w in 1980, prod- 

ucts and; publications that were deyelopiwl^ 

were reviewed - by the { program the product was 

furided. This meant that decte^^ whether'or not to publish or 
prbduce these' nmteirialst^^ by^ the piersonriel who, were 

most knowledgeable: about the prcKiucts^smd often niost committed 
to the subject matter; vThese procedure vwere chainged iri April 
1981; when the Office' of Management and Budget (0MB) tissued 
Bulletin 81-16, entitled ^Eliniination of Wasteful Spending on Gov-V 
ernment ^Periodicals, Pfuriphlets, ^fim Products." lii 

this bulletin,; 0MB expressed concern that there was too much du- 
plication ; and waste : in publications and audio visual products in 
the Federal Goveriunent. This directive required a moratorium on 
publications and products funded by the Department of Education 



^!i;;;imta a'/i^^ by 0MB iand put^ih . 

^plMe,;: lasted from. Apnl:^1981 : iiritU Ap 

^.r^eSrf^ prdduceMi; Theselinclud^ Con- 

^v ';^^^g^i^^ had ialready Been cbi> 

■ ; v i^trac^ meA^rislB deemed ' necessary by the Secretary of 

^? >^:^ As'a direirtive; the PubUcation^^^ a^^ Audio 

i ;^: :;^,yisual ;Adv^^ was created in 1982 to review all 

v'publica^ This af- 

■ '^fected^^^'p^ pro- 
^x; graiMj such: M National Institute of Education, Women's Edu- 
V V; cational Equity^^^^^ Office of Special Education and Re- 
v^::habiUtetiye; Services, ^^0 Minority 

0v^^(rhjs^^ m years, although 

; V it was a^^ for Legislation 

; -aiidrPi^ six 
tether the Deputy Under Secriet^ fb^^^ 

^f^, • me^^ se^yed^^M^ Deputy 
;Vnd^ Intergovenunental and Interagency Affairs; 

: the^Ajasistant Seci-e^^ Improvement 
(QERD; and two rotating seats held by the Deputy Assistant Secre- 
: taiy fo^^^^^ Services; and the As- 

; J^^^^^^ Elemeni^^ Four 

■; of the meinbers had some experience as teachers at the 'elementary 

■ but the imembera w^ primarily experienced as ad- 
V mii^ ^ educational or professional back- 

^ had 
^5;;; expertise iii the^ PAVAC, 
> M other; than li^^ 

: - limited ^peil^ reflects 
; : an experience com- 

■ P^^j<^/e criticism 

■ prtite PAyAC^ For exam- 
, : : p ResearcK'and Improve- 
ment, the. onfe; member witii expertise iri '^ucationa^ 

invited toi^seryep 27, 1985, shortly after 

; several articles criticizing the PAVAG process had appe^ed in the 

■ i; Chrbriicle of Higher Education, Education^ other educa- 

tion penodk of iriost PAVAC members 

■ v 1? Hearing, before £1 Bubcommittee of the Committee on Government Operations, House of Rep- 
. resentatives, 'Limits; on the Dissemination of Information by the Department of Education," 

Nov. 13,; 1985,' hereinafter referred to as Hearing; testimony of Anne Graham, Chair of PAVAC 
, / and Assistant Secretary forXegislation and Public AHairs; prepared statement, p. 72. • 
. r * Hearing, Graham testimony, j). 81. V:::'*-V. - . . ; . . ... 

■ ' ' A Persbriil QuaUficatiohifStatements are available in subcommittee files- ' 

. 7- .1 The invitation was made in a memorandum from Anne Graham, Chair of PAVAC and As- 
/ : sistant Secretaiy' for L^ialation and Public Affairs .to Chester Finn, Assistant Secretary for 
;Edu^txo^Dm Rerfearchiand Improvement,* Aug; 27,^^^ articles include 

V ' §^ Pahner,"U.S. Delay, of Education Publications: Some See Red Tape, Others Cen- 

BorsKp,'* Chronicle of Higher Education May 8. 1986,jpp. l;and 6; "Federal Reviewers End Long 
; .;^DeIav onPrmting Rwults of Research," Chromcle of Higher Education, May 29. 1985. p. 19; and 
Vf: . . one by Diane^ReiB, ; "ED Savs Mt^ority of NIE Documents Approved, But Evidence Unclear," 
; : Education Daily, Apr, 80, 1985, pp. 3-4. ■ : • ; . - * . ' . ■ ^ 
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i^; ■ !Educati6n;lGary ■ ■ V^;^-^ ;^ !: " • ^ ■ ' . ; ' ,v' ^ ■ ^ ' ^ 

iK>6;,Starting;m reviewed pubUcations £^ r 

fSlfm prograins, 

i-^siich as'th'e^Wom^^ the Office 

of Bilingualj Education::^ £m Langiiiaig^ Affadrs/ Indian 

^Education Prograrias, ^ of Special Education and Reha: 

SbUitetive Services, fc^^^^a^ public 

inform biwhures,, audi6^^ more substantive 

• if ai^ were intended to provide informa- 
J tipn :'about ^^teaching tec materials to an audience of 

^^^^ -y^^^^^^ 

: " To imd problems presented by PAVAC, it is necessary 

to delineate the reyiew process, for of Education publi- 

cations and audio ^visual prodiicts^AV, V > V 

Firat, grants and contractsVnegotiated with the Program Office 
(for example; Wome Program, or Bilin- 

gual Education), specify,/ how .much^'^^m^^^ 

- search or development ^6f a 'program, and the type of products that 
will result; such, asla reiw or, manual; describ 

^' tibrial methods bivcufricM^ ■ : V ^ v 

After the reseMch and development is completed, the. Program 
Office evaluates each pr^ audio yisuial product , 

on the' basis of eight. criteria: need, estimated size of tai^et;audi- 
encej smtable 'foraat, c the speicific 

medium, p^rq method of production or procurem^ 

; aiid plans^fpr; e vialuation,? ' Although^ products ' and : dissemination 
'plaiis l]Sd^))iBen; reviewe^V grant - stage and the 

Prbgrieun in 1982, the 

1982 [Directive is;more^:8pecific /a^^ to be ,con- 

'igideredbyJtiief'Pfbgi^ v^- /■■^!;':;.;' > 

V Third, if the Program Office appirbyes' the proposed product/ it is 
■ ' submitted' to the Assistaint Secretary ' of Principal Officer\resp6nsi- 
blelfqr : theypf ogram^ (f^^ the; Assistint for Ele- 

- ^ment£ucy aiid S^ 

^ ^^^^ same criteria as 

• ■ the iw^^ and alro assess wheth^ duplica- 

tive 'bf existing agency rbr Government prcxiucts; the appf o- 

pnateh«3s 'bfrmethod ' 6 fro^. 
r : ik)int/bf vi(BW, the consisted and 
goals, and the ccisfc^ffectiveness relativ^^ 

fundig- mechanism,: cbst^^^ plan.'' 
r K the Princapcdi Offic^ supports a , request; forms are; completed 
regarding the cost of develbpmg and iirinting the product, determi- 
nation of audience need, . methods of dissemin^ion,^^ 



» Memoz^diun from Gaiy L. Bauer/ Under Se^ of Education; to Anne Graham, Chair 
of PAVAC, Sept 18, 1985, in Bubcommittee fJes. ; - ^ f ' - ■ ■ , ^ 

•PubUcaUon and Audio Visual Control System (PACS). ED Administrative CommunicationB 
SvHtem Departmental Directive. A:MIS:1-110, Oct 21, 1988, p. 8. Hereinafter, this directive will 
bereferr^JftoasPACS, A;M1S:1-110.' : .-^yV . . . . . - ^ 

^Ibid.,pp.3-4. , \:V - ' ^ . i ■ : 
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? of the, requ(M^^ effectiveness^® 
?:This infoima^^ memoran- 
;^^ dum endorsing th^propK^^ 

P yAs the firet /step the Publications and 

Audio b Visual fAcq^^ 

' the •inforajatioh^a the ■ forms' and^ en- 

. dorsemeht meinor£^ deiscribfed above/ and presented this ' infor- 

mation- to' the -PAVAC^^ m 
; leviel fidl-tme*(^^ who was -a^i^^ a part-time 

: bMis by support stiaff and professional staff. According to the De- 
partnaent of Education and PAV AC review cri- 

teria^ at: a-m 

: User, and Prmcipai pffic^ imdMso "(a^ ias; to form 

and required d(x:iimentatioia;;(^^ conformance with policies and pro- 
cedures of PACS [Publication and Audio Visual Control System]; (c) 
easentiaUty,^ i.e.,' the degree to C which the procuremen or produc- 
tion pf the P/AV IpubUcation/audio visual] is so important' that 
without the P/AV.the program wi^ mission; (d) cost- 

effectiyeness, both frpm^^^ 

proposed method of production;' to m^^ 

specifications which appear as Appendix 2 of this directive; (e) the 
\ abiUty of the product to achieve the stated goal; (f) the need for ad- 
ditional: internal coordination; (g) departmental priorities; (h) con- 
formance with' legislation, regulation and policy; and (i) the suit- 
abiUty of the message , ; 

PAVAM evaluated each product, and for those products that cost 
$2,500 or less to deyelop and produce, or were • recurring publica- 
tions that had received PAVAC approval in a prior year, PAVAM 
was empowered to make a final decision. PAVAM submitted all 
other proposals to PAVAC,\ specifying any recommended modifica- 
tions, with* a recommendation ^ for . approval or disapproval of the re- 
quest. PAVAC members then^ discussed the ^ proposals, voted, and 
sent their decision in a memorandumito the Office of the Assistant 
Secretary or Under Secretary for the specific program area.^2 

If the . Principal Officer, such as the Assistant Secretary for Ele- 
naentary and Secondary. Education, disagreed with a PAVAC deci- 
sion, he or , she had 15 days to appeal the decision. In order to 
appeal, the officer had to submit an appeal package consisting of 
the original materials submitted to PAVAC, the official notification 
letter that disapproved or modified the original request, a memo- 
randum of endorsement of the appeal fix)m the Principal Officer 
and;ai justification for the appeal. The justification had to detail the 
essentiality, costHBffectivehess, timeliness, and any other issues rel- 
evant to the appeal;- Supporting documents fi-om other offices were 
also recommended. PAVAC then re-reviewed the materials, and if 
it voted not to reverse its original decision, the appeal package was 



• Hearing, Graham testimony, prepared statement, p. 76. 
; " Hearing, testimony of Dr. Samuel HarriB, PAVAM staST, p. 82. The references to PAVAC are 
m the part tense, although almost all the procedures are identical under the PublicaUon Review 
Board, which replaced PAVAC. , . 

>0PACS. A:MlS:MlO,p.4. 

» Ibid., p. 6. 

Graham testimony, prepared statement, p. 77; PACS, A:MIS:1-110. p. 9. 
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kij^fbmarf Under 
Ivr; Se^^ (decision and could overturn it. ^ i , 

vi^^^^^ proposed publi- 

F^ .;^ investigation focused on the 

V :/JWoinen'^ (WEEA) Program: Since its enact- 
, ^ ment in 1974,'')yEE!A incluiied dissemination pf^materials as an im- 

^pk)rti^ model pro- 

; ; grams !^devel6ped.^^^ at low 

: : cost to educatora^^a^ the coiuitry/This dissemination was consid- 
; ' eredjc^^ than 

$6 riailUotf eaxii 

: Center published over 

V 250 prbducts and Mid mOT^ to produc- 
tion,, eiach product from each grantee was evaluated by the editori- 

: al staff of the Educational Development Center of Newton, MA, 
which is cbhtxacted to Publishing Center; a peer 

: review pfimel of 3-5 e selected by the 

^ ;W College Center for Research on Wpinen,'under a subcon- 

tracting arrangement; and the WEEA Prbgraiu staff. Although the . 
Department of Education terminated th review process in 

; 1984, aU of the WEEA products that were reviewed by PAVAC had 
been evaluated under the panel review system.^^^^ 
lishing Center editors with reviewing 

technical aspects of production and printing, and these reviews con- 
tinue under current PubUcatioh Review Board ^^^p 
■ panel' review process included more substantive criteria: need for 
the product, content and quality, effectiveness of instructional tech- 
nique, and technical quaUfy/ lliese reviews were presented as sev- 
eral pag^ of detailed evaluations of each product. Summaries of 
the paneliste; comments and suggested modifications were also pro- 
vided to the grantees who developed the materials, to assist them 
in improving the jproduct, whether or not it was recommended for 
publication. The WEEA Publishing Center staff also estimated the 
cost of i)roduction te camera-ready form,' and deterniined the cost 
of printing, using a pricing formula^based on the; Government 
Printing (MRce guidelines and regulations.** The publishing center 
set a pnce that was intended te make the producte accessible to the 
.target audience.^*' -These procedures were applicable to all the 
WEEA products that PAVAC reviewed, although the role of the 
.W1BEA Publishing Center has been weakened since^^ 

: In EY 1988, 72 percent .of the products proposed by WEEA were 
rejected for publication by PAVAC. In FY 1984, 46 percent of the 
products, which represented 66 percent of the WEEA projecte, were 
rejected. As a result of this, high -rejection rate, Congress amend- 

" PACS, A:MIS:1-110, p. 10. 

^* The pricing formula had already been approved as part of the WEEA contract. 
Hearing, testimony of Dr. Leslie Wolfe, Director of Project on Equal Education Rights, pre- 
rparedstatemciit, pp. 34-88. 
- ; v'o Eleven cf 24 products were rejected, representing six of the nine WEEA projects that pro- 
posed public itions or audiovisual products. This does not include the PAVAu approval of the 
. .WEEA nnni\al report, or the approval of a brochure on sexual harassment that was developed 
' V Continued 
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ed the Women's Educational Equity Act in 1984 to mandate that 
the WEEA office "shall evaluate and disseminate (at low cost) all 
matenals and programs developed" under WEEA. The amendment 
was designed "to ensure that the original intent of the law to make 
Aese materials widely available is carried out." Nevertheless, in 
1985 only two of 10 (20 percent) products submitted to PAVAC 
; were approvedfor publication.18 

/ r EDUCATIONAL LABORATORIES AND CENTERS 

A second major focus of the subcommittee investigation was the 
publications funded through 12 regional educational laboratories 
and national educational centers that received money from the Na- 
tionj^X Institute of Education (NIE). Educational laboratories and 
centers received funding from NIE to assess ways to improve edu- 
cational instruction and school administration, and to develop ma- 
terials that , can be used to disseminate that information to educa- 
tors and schools in each region. Although they received other 
fundmg from Federal and non-Federal sources, NIE was a major 
source of income for those institutions. 

^Congress mandated that dissemination )be a primary aspect of 
the work of these educational laboratories iand centers. According 
. to the legislation authorizmg NIE, "Laboratories are to insure that 
uiformation developed as a result of their research and develop- 
ment activities, including new educational methods, practices, tech- 
niques, and products, are disseminated." ^o Educational research 
products funded through NIE came under PAVAC review for the 
first time in November 1984, when nine educational laboratories 
and centers; signed contract modifications which stated that ap- 
proval must -be obtained , from PAVAC for the development and 
production of any publication or audiovisual product.21 The modi- 
fied contract also stated .that -all products requiring more than 50 
T>TT?Ain,®^^®^^ final reports, would have to be reviewed by 
PAVAC, even if their production had already been approved by the 
Department as part of the contract negotiation. 2 2 
r In January 1985, NIE asked the laboratories and centers to pro- 
vide infprmation about the titles, number of copies needed, and - 
costs of their proposed products, and this information was used to 
complete forms that NIE submitted to PAVAC.23 Informally, high- 

ri^Slbfl AiiT^^y ^^?TA%rYS'?®"'« Educational Programs, which is composed of po- 
^ ^^r*^® '^"^P^®^ PAVAC forma and correspondence are available in subcommit- 

Report'^^748'^^15"^^^' ^^'^ Educational Amendments of 1984, House 

«nwJiiS°/"5^ri^ hearing, the administration witness claimed that two of nine products 
S^aS i^^ji^i * approved, (Hams. p. 87). However, documents that the Department 

?l?n^ w indicate tfiat a tenth product entitled "Between a feck and 

a Hard Place: When Raosm and Sexism Intersect In Education" was also rejected These docu- 
ments are available m Bubcommittee files. 

8eI^&Imi«vT^enU&!"^^^^ ^"""^"^ through the Office of Educational Re- 

' 2? General Education Provisions Act. GEPA 405 (fXcXiii). 
•in Novemb!^*1985*^® ^^^^^ educational laboratories and centers signed contract modificationfl 

presented by Dr. Robert Rath. Director of the Northwest Regional Edu- 
catipnal Laboratory, prepared statement, pp. 11-12. 
as Ibid., p. 14. 



8 

ranking NIE officials advised the educationcd laboratories and cen- 
ters that PA VAC would probably provide NIE with blanket exemp- 
tion for its contractors.^* It was apparently their expectation that 
fidl products funded through NEE contracts would be automatically 
approved by PA VAC, since they had already been approved as part 
or the contract negotiations and again by the NIE program officers. 
Chi tho assiinlption that approval would be automatic for all pro- 
posed products, NBE officials advised the laboratories and centers 
to request approval for everything they were going to produce, 
even if PAVAC approval might not be necessary. For example, ap- 

Eroval was not necessary for any publication of under 50 copies, 
ut the laboratories and centers was encouraged to ask for approv- 
al of such publications if there was any chance they might eventu- 
ally require more than 50 copies. That way, neither the educational 
lalioratory nor the NEE would need to waste time seeking PAVAC 
approved at a later date. 2^ 

The information provided by the laboratories and centers was 
submitted to PAVAC by NIE in February and March, and the ini- 
tial submission of the_proposed products of six laboratories and cen-. 
ters was reviewed by PAVAC on March 5, 1985.2e On April 9, 1985, 
more than five months after- the modified NIE contracts were 
signed, PAVAC met and rejected NEE's request for blanket approv- 
al of all educational laboratories' and centers' publications. Two 
days later, NIE r^uestedi additional information from each of- 
these institutions regarding the proposed publications and products 
submitted for PAVAC review.^'' 

On May. 16, 1985, the -laboratories were notified about the 
PAVAC decisions in an informal memorandum dated May 10. Of 
the 353 publications that the laboratories and centers had submitp 
ted for PAVAC review, only 89 (25 percent) were approved; 86 (24 
percent) were approved for development but not for printing, 90 (25 
percent) were rejected,' 81^(23 percent) were considered incomplete 
submissions, and 7 (2 percent) did not need approval. The laborato- 
ries iand centers were told that they could appeed the PAVAC deci- 
sions.2®:.' ' : . ^ ' ' . . •,, 

At this point, it became apparent that some of the information 
included in the formis reviewed by PAVAC was incorrect, and that 
these errors might have had a detrimental impact on PAVAC deci- 
sions. The laboratories had been told that they should specify de-, 
velopment costs, and printing costs on the PAVAC review forms, 
but the definition of development costs had been xmclear. In re- 
sponse to a request for clarincation, Mr. Ray Wormwood, contract^ 
ing officer ofNSE, sent a letter to the laboratories on May 24,1985, 
which defined development costs as "the cost of producing the 
ph3rsical product, publication, or audiovisual itself. Development 
cost does not relate, in an v way, to the research and development 
costs involved prior to . the physical production of the product 
(typing, editing, layout, printing, etc.)." 2® 



«*Ibid..p. 13. 

"Ibid., p. 12. . ^ 

. These documents are available In subcommittee files; the Mar. 5, 1985, date was cited at 
the Hearing, testimony of Dr. Samue> Harris, p. 85. 
Ibid., p. 6. . 

14 



This definition was important for three reasons. First, PAVAC 
review was not required for any product that cost $2,500 or less. 
Many of the laboratories' publications had been described as cost- 
ing more than that, because development costs had been defined as 
including the research and writing of the product. When those 
costs were subtracted, most of the products cost well under $2,500, 
and could therefore be reviev^ed by ihe PAVAM staff instead of 
PAVAC. Secondly, by using Mr. Wormwood's definition of develop- 
ment costs, it became more obvioiis that the costs associated with 
publication were niinuscule compared to the money that had al- 
ready been spent on the projects. In addition, Mr. Wormwood's 
definition of development meant that the laboratories could contin- 
ue to do the research and writing, needed to produce the product, 
even if the product had not yet been approved. Under the previous 
definition of development, any. work related to the product would 
have had to cease until PAVAC approval was granted, thus delay- 
ing the research and writing for several months. 

Although Mr. Wormwood's definition of development should 
have eliminated many proposed products from PAVAC review, 
PAVAC decided to review all products, regardless of cost.^^ The ap- 
peals dbcumentig reviewed by PAVAC included information about 
all the publications that had been rejected by PAVAC, except for 
the ones where the number of copies was reduced to less than 50, 
or those that were ho longer requested because the delay had elimi- 
nated their usefulness (such as winter and spring newsletters). 
.. In August 1985, PAVAC rejected more than 80 percent of the 121 
proposed publications that were submitted by the Office of Educa- 
tion, Research, and Improvement (OERI) on appeal.^s A spokesman 
for the PAVAC Chair defended their decisions, saying "If the lab- 
oratories don't like these government limitations, maybe they 
should look for money from the private sector." 
. However, oh September 18, 1985, Under Secretaiy Gaiy L. Bauer 
sent a , memorandum to the PAVAC Chair, stating that he had 
overturned PA VAC's decisions and approved all 98 proposed publi- 
cations that had. been rejected on appeal. He stated that "I have 
decided to accept the recommendations of OERI and approve their 
appeal.'' My decision is based on the following considerations: 

This was [the] first time that PAVAC hai3 reviewed the re- 
search products of the labs and centers. 

PAVAC's membership is in transition; The new members of 
PAVAC will include individuals who are familiar with the re- 
search products produced by the labs and centers. 

PAVAC's functions and role within the Department are also 
under review. 



Copies of all the financial information submitted to PAVAC are available in subcommittee 

files. 

Hearing* app. 1, p. 143. 

. 8" NIE had been under the jurisdiction of OERI; when NIE ceased to exist after a reorganiza- 
tion of the Department in FY 1986, the ftinctions of NIE were taken over by OERI. 
\i '/i^Jffn^li teatimony of Dr. Rath, prepared statement, p. 16; uncited quote from article enti- 
tled PAVAC Rejects Mor^ Appeals, Labs Dismayed," Education Daily, Aug. 15, 1985. p. 3. 



. The new Assistant Secretary for OERI has received the deci- 
sions of PAVAC and the materials appealed by OERI. He has 
; recommended to me that the OERI appeal be sustained. 

V . THE PAVAC RECORD 

Between 1983 and the time of the hearing, PAVAC had reviewed 
more than 1,000 proposals. According to the Department's statis- 
tics, PAVAC had "approved nearly .83% for publication or produc- 
tion, and achieved savings of almost $2 million' dollars."^^ Howev- 
er, the 83 percent approval rate is misleading, because it includes 
PAVAQ decisions to include articles in the Educational Resources 
Information Centers,(ERIO. 

ERIC entries shoidd not be considered PAVAC approvals for two 
reasons. Fii^t, any publication caii be submitted for inclusion into 
ERIC, whether or not PAVAC approves it. Therefore, PAVAC ap- 
proved is urelevant to inclusion in the ERIC system. Second, ERIC 
is an information storage and retrieval system, not a publication 
system. Titles of articles available through the ERIC system are 
listed in books or available through computer software ini a small 
proportion of public and private libraries. The articles themselves 
are av^able in approximately 750 libraries, but only on microfiche 
(for use in the library) or photocopies that can be ordered for a fee. 
Thu^, the information' from documents stored in ERIC is available 
only to those who have access to a library that subscribes to the 
Research in Education (REE) part of the ERIC system and are will- 
ing to read microfiche, or willing to fill out an order form, pay ap- 
proximately 10$/page, and wait for a few days or weeks for a pho- 
tocopy. • 

ERIC is a system designed to make articles with a limited audi- 
ence available to' people who are willing to spend some time or 
money to obtain access to them, and is most often used by students 
and scholars. More than 70 percent of teachers, principals, and 
school librarians teve never used ERIC, and even fewer have used 
the RIE system.^"^ those reasons^ PAV AG's decisions to include 
a product in ERiv iy it not approve if for publication should not 
have been included in the proportion of "approved" products. Rec- 
ommendations' for inclusion in ERIC were often appealed by the 
Principal Offices, and thus treated by them the snrae way as the 
other rejected products.^'' 

PAVAC did not approve the majority of products developed by 
the WEEIA projects and the educational laboratories and centers 
for publication. In contrast, the majority of the proposed products 
submitted to PAVAC by the Office of Bilingual Education and Mi- 
nority Languages Affairs and the Office of Special Education and 
Rehabilitetive Services were approved for publication. In FY 1985, 
the approval rates for these products were 90 percent (nine of ten 
products) and 82 percent (27 of 33 products), respectively. In FY 



3* Memorandum from Gary L. Bauer, Under Secretary, to Anne Graham, Chair of PAVAC, 
Sept 18, 1985, in Bubcommittee files. 

Hearing, Graham testimony, prepared statement, p. 77. . 

Cost and Usage Study of the Educational Resources Information Center (ERIC) System: A 
Descriptive Summary, by Joseph L. Heinmiller, NIE, 1981, pp. 9-11, in subcommittee files. 
PAVAC appeals documents are available in subcommittee files. 



1984, PA VAC approved all three products proposed by the Office of 
. Bilingual Education and three of the five (60 percent) proposed by 
Sjpecial Education and Rehabilitative Services. However, in FY 
•1983, PA VAC approved only 33 percent (3 of 9) from Bilingual Edu- 
. cation and 32 percent (9 of 28) from Special Education. 

The products proposed by these two programs were often much 
more expensive than those for WEE A or the educational laborato- 
ries. For example, the three Spiecial Education audio visual prod- 
ucts that PAVAC approved in F5r 1984 cost over $1,090,000, more 
than 7l6 times the cost of all the WEEA proposed products com- 
bined for F5r 1983-85. In contrast to both WEEA and the educa- 
tional laboratories, where the m^ority of products that PAVAC re- 
viewed would have cost imder $2,500, all Special Education and Bi- 
lingual Education projects costing $2,500 or less were reviewed and 
approved by PA VAM, rather than PAVAC. 

The statistics for the Office of Bilingual Education and Minority 
.Languages Affairs and the Office of Special Education and Rehabil- 
itative Services show that the more recently proposed products 
have been more acceptable to PAVAC. In her testimony, the Chair 
of PAVAC stated that approvals increase as the Program or Office 
becomes more selective in what they submit to PAVAC.^^ Howev- 
er, this selectivity sometimes results in much fewer products being 
proposed, as was the case in FY 1984. 

THE REVIEW PROCESS IS MODIFIED 

On November 5, 1985, five months after the subcommittee noti- 
fied the Department of. Education of the investigation and one 
week before the subcommittee oversight hearing, the Department 
announced that the PAVAC v/ould be replaced with a new entity 
called the Publications Review Board (PRB). The main differences 
between the PAVAC and the PRB are as follows: 

Research publications funded by grants, and publications 
funded by contracts which are determined to be research by 
the appropriate Assistant Secretary, are exempt from PRB 
review. 

PRB is chaired by the Deputy Under Secretary for Manage- 
ment (who was the Vice Chair of PAVAC); the Vice Chair is 
the Executive Assistant to the Under Secretsuy (who had been 
a member of PAVAC at one point, but was not a member in 
the fall of 1985); and the third permanent member is the 
Deputy Assistant Secretary for Public Affairs (formerly the 
PAVAC Chair). Two offices, OERI and the Office of Planning, 
Budget, and Evaluation, are represented by Career Senior Ex- 
ecutive Service representatives (one from each office) at each 
PAVAC meeting. In addition, two Career Senior Executive 
Service staffers represent the following offices on a rotating 
: basis, as determined b^ the Chairman: the Office of Special 
Education and Rehabilitative Services, the Office of Elementa- 
ry and Secondary Education, the Office of Postsecondary Edu- 
cation, the Office of Bilingual Education and Minority Lan- 



»8 According to documents from FY 1984, available in subcommittee files; these statistics were 
not provided to the subcommittee for FY 1985. 
^"Hearing, Graham testimony, prepared statement, p. 77. 
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guages Affairs, and the Office of Vocational and Adult Educa- 
tion. , 

PAVAM is replaced by the Publications Review Staff (PRS), 
which will be increased in size. 

Proposed publications will ''receive increased scrutiny at the 
time of award." 

in. Findings 

1. THERE WERE NO SAVINGS TO THE FEDERAL GOVERNMENT WHEN 
PRODUCTS OP THE EDUCATIONAL LABORATORIES AND CENTERS WERE 
REJECTED BY PAVAC ' 

The Federal. Government did hot save any money when a pro- 
posed publication- of the educational laboratories and centers was 
rejected by PA VAC. That is because any money that was not spent 
on publication could be kept by the educational laboratories and 
centers, rather than returned to the Federal Government. 

At the hearing, the Chair of PAVAC justified PAVAC review as 
a cost-cutting process, by explaining that this money could be used 
by the educational laboratories and centers for other purpose.'* ^ 
However, the cost estimates provided by the laboratories and cen- 
ters to the Department and the subcommittee indicate that the de- 
velopment and printing, as defined by PAVAC, are a minute pro- 
portion of the research and development moneys approved for each 
project. For example, a computer technology program developed by 
the Northwest Regional Laboratory had a total. R&D budget of 
$267,923. Of this, approximately $7,000 was needed for development 
of the proposed publications and $2,980 was needed for printing 
costs, for . a total of $9,980, less than 4 percent of the total budget. 
Similarl3% a project entitled "Center for Performance Assessment," 
funded at $228,915, required only $970 for development and $737 
for printing of the proposed publications on classroom assessment 
and teacher evaluations, which totaled $1,707, less than 1 percent 
of thebudget.*2 

It is unclear exactly what will happen to unexpended funds for 
products rejected by PRB. The Department witnesses did not ad- 
dress this question. However, even if the moneys are returned to 
the Federal Government, the statistics cited above demonstrate 
that the amount saved is very small compared to the amount al- 
ready spent to develop the product. 

2. THE MONEY SAVED WHEN PAVAC AND PRB REJECT WEEA PRODUCTS IS 
A VERY SMALL PROPORTION OP THE MONEY SPENT TO DEVELOP THOSE 
PRODUCTS 

In most cases, the Federal Government saves a few thousand dol- 
lars when PAVAC rejects WEEA publications. This represents a 
very small proportion of the total amount spent in the research 
and writing that was completed before the publication was given to 
PAVAC or PRB for review. 



'*°Fact Sheet of the Department of Education, Nov. 5. 1986, in subcommittee files. 

Hearing, Graham testimony, p. 93. 
""Hearing, testimony of Dr. Ratn, p. 55. 



13 

Relatively modest Federal funding was requested for the WEEA 
publications, because they had already been typeset and only re- 
quired money for printing. For the WEEA proposed publications 
that were rejected by PA VAC in FY 1984, $429,834 had already 
been spent on those projects, and only $18,606 had been requested, 
for publications aimed at disseminating the information from the 
projects. This represents only 4 percent of the Federal funding that 
had already been spent. For the WEEA proposed publications that 
were rejected by PAVAC in FY 1985, $615,847 had already been 
spent on the WEEA projects and an additional $13,194 (2 percent) 
had been requested for publishing costs.^ 

For example, a project on Asian women was funded at $261,285, 
where all three proposed publications were rejected in FY 1985. 
These publications ranged in cost between $509, for 300 copies of a 
manual for training professional Chinese American women, to 
$1,400 for 300 copies of a manual for counselors and researchers in- 
terested in the career development of Chinese American women. 
These costs range from less than two-tenths of 1 percent to half of 
1 percent of the Federal money, that had already been spent on the 
project. Since all the products were rejected by PAVAC, the infor- 
mation from the project on Asian women was of benefit only to 
those who .'actually participated in the model program. However, 
the grant had been funded with the understanding that the model 
program would be used to develop handbooks and a bibliography 
that would be disseminated to similar programs across the country. 
, Since "all WEEA publications are sold by a national clearing- 
house at cost, all profits from publications sold would have been 
used for later printing costs. Recent sales figures indicate that 
these products are selling well, and that WEEA publication costs 
are^ less than 3 percent of the money brought in by the sales of 
WEEA products.^?. .Therefore, the printing moneys requested were 
a:pnetime cost, and a substantial proportion if not all of the funds 
would have been recovered through the sale of the publications. 

In addition to a small amount of savings relative to the cost of 
the projects, rejected publications also reflect an almost complete 
waste of the money spent on the projects. The purpose of the 
projects Tunded by WEEA and the educational laboratories and 
centers is to make new curricula, teaching methods, and other in- 
formation available across the country. If funds are spent to devel- 
op training materials that are never made available, then the mil- 
lions of dollars have been completely wasted. - 

V 3. PAVAC REVIEW PROCEDURES COST ALMOST AS MUCH AS THE 
' ' . REJECTED PUBLICATIONS 

The costs delineated above do not include the cost of the PAVAC 
review procedure itself. One educational laboratory estimated that 
their work in preparing information for the PAVAC review cost at 
least 30 staff days.^^ All the information required by PAVAC for 

y*^. In the first nine months of FY 1986, WEEA sales totaled $123,723, whereas WEEA publica- 
tion costs approved in FY 1986 (the last year when products were approved) was $3,196: in sub- 
committee files. ' 
. ♦* Hearing, testimony of Dr. Rath, p. 54. 
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the 353 proposed publications of the laboratories and centers was 
compiled by NIE and OERI, and they had to work closely with the 
12 institutions involved, which translates into a considerable 
amount of Department staff time. In addition, the direct cost of the 
PAVAC review process can be estimated in terms of the PAVAM 
full-time staff, which costs the Federal Government $47,300 per 
year in salary and benefits, at least $10,000 each year for the part- 
time salaries of several other staff of the Department who were as- 
signed to PAVAC review, and a proportion (2 percent) of the ap- 
proximately $70,000/year for salaries and benefits of the six senior 
staff who are PAVAC members, which equals $8,400.*^ 

These costs of PAVAC are disproportionately large compared to 
the costs of many of the rejected products, particularly those cost- 
ing under $2,500. Tor example, the annual salary for the PAVAM 
staff member is considerably more than the $35,000 "saved" by re- 
jecting WEEA products over a 3-year period.'*® 

4. PAVAC AND PRB MEMBERS LACK SUFFICIENT TRAINING AND EXPERI- 
ENCE TO REVIEW- THE MERITS OF PUBUCATIONS IN THE AREAS OF 
EDUCATIONAL RESEARCH AND CURRICULUM 

-Most of the members of PAVAC had virtually no substantive ex- 
perience in the areas of education or research represented by the 
publications under investigation.* None of the members had experr 
* tise in educational' equity, bilingual education, or Indian education. 
One iriember is employed in the Office of Special Education and 
Rehabilitative Services,* but had ho expertise in .special education 
prior to that appointment. Although three PAVAC members have 
doctorates, including two members added within the few months 
before the subcommittee hearing, only one had expertise in educa- 
tional research, according to information - supplied by the Depart- 
ment.^'^ The positions held by the members of PAVAC for the mpst 
part reflect experience with public relations, management issues, 
and the law, which might-have been appropriate for a review based 
oh fiscal : considerations, , rather than substantive content. One 
member had some teaching experience at the elementary level, onie 
at the college level, and one at the secondary school and college 
level, but in all cases the teaching expertise was less substantial 
and less recent than their administrative skills; for example, the 
PAVAC Vice Chair had left teaching ten years earlier. 

.Of all the members of PAVAC, the Chair apparently had the 
least expertise in education. She testified that , she had no experi- 
ence in the field of education before becoming Assistant Secretary 
for Legislation and Public Affairs in the Department. Taken all to- 
gether, the appointments made to PAVAC, particularly as reflected 
in the PAVAC membership before the subcommittee's investigation 



These figures are based on salaries and fi-inge benefits of one PAVAM full-time profession- 
al staffer, 25 percent time for the PAVAM secretary, and smaller percentages of time for other 
staff; the 2 percent estimate is based on the PAVAC Chair's. testimon^r that she spent 1-1.5 
hours at each PAVAC meeting, which was held twice each month accordmg to PAVAC minutes; 
salary information is in subcommittee files. The Department reports that the PRB met only five 
times between Nov. 5, 1985, and Aug. 31, 1986, which would cost less than the 2 percent esti- 
mate, despite the increase in the number of PRB members. However, during the first eight 
months or PRB, PRB did not review any WEEA products or educational laboratory products. 
. '•^ In subcommittee files. 

R^um^s and personal qualifications statements available in subcommittee files. 
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became known to the Department, suggest that PAVAC was not in- 
tended to make decisions about the substantive content of the pro- 
posed publications. 

In her testimony, the Chair of PAVAC stated that PAVAC mem- 
bers did not have or need expertise in the content area (e.g. educa- 
tional equity or educational research) "because we didn't deal with 
content;. However, PAVAC review criteria were unquestionably 
based on content. For example, the criteria that PAVAC cited for 
all rejections of WEE A products in FY 1985 and FY 1984 was lack 
of "essentiality and timeliness."/*^ These judgments are best made 
by people with an understanding of the substance of the publica- 
tion and the needs of the educators in the field. . 

This problem was iacknowledged by the Under Secretary of Edu- 
cation, Gary Bauer, when he overturned the PAVAC rejection of 
products developed by the educational laboratories and centers. In 
his memorandum, he implied that previous PAVAC decisions had 
been made by members with no expertise in the type of research 
conducted by the laboratories and centers, when he stated that this 
situation would improve as a result of new PAVAC members that 
had been added.^9 . 

5.. PAVAC AND PRB MEMBERS LACK THE EXPERTISE NECESSARY TO MAKE 
APPROPRIATE DECISIONS ABOUT DISSEMINATING RESEARCH RESULTS 
AND TEACHING MATERIALS 

PAVAC members' lack of expertise in the field of education was 
reflected in their statements on dissemination of information. For 
example, the PAVAC Chair and Vice Chair testified that the Edu- 
cational . Resources Information Centers (ERIC), an information 
storage and retrieval system available through major libraries, was 
a superior alternative to publications for many educational prod- 
ucts.^ ^ These comments were strongly rebutted by the laboratory , 
director and an educator who testified at the subcommittee hear- 
ing.^2 The Director of the Northwest Regional Educational Labora- 
tory testified that most of the publications that PAVAC had limit- 
ed to inclusion in ERIC were research materials that were intended 
for a .wide audience* of teachers and administrators. He was con- 
cerned that the intended audience would not read materials that 
were only available through ERIC, which he referred to as "re- 
search : archives." In the appeal memorandum to the Under Sec- 
retary,' Emerson Elliott,. Acting Assistant Secretary for OERI, 
stated "It is the considered opinion of these experts that much of 
the information would be unused if not produced in hard copy and 
distributed to appropriate educators and other users."^'* 
• These concerns are well founded. The Chair of PAVAC testified 
that there are 10 million ERIC users each year, but the correct 



Hearing, Graham testimony, pi 99. 

Hearing, testimony of Dr. Harris, pp. 87-89; and documents in subcommittee files. 
B° Memorandum from Gary L. Bauer, Under Secretary, to Anne Graham, PAVAC Chair, 
Sept. 18, 1985, see p. 15 of this report or subcommittee files. 

Hearing, Graham testimony, pp. 88, 93, 98, and Dr. Combs testimony, p. 104. 
"2 Hearing, testimony of Dr. Rath, pp. 60-61, and Richard Long, p. 132. 
"3 Hearing, testimony of Dr. Rath, pp. 60-61. 

Memorandum from Emerson Elliott, Acting Assistant Secretary for OERI, to Gary Bauer, 
Under Secretary, June 27, 1986, p. 2, in subcommittee files. 
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figure is that ERIC is used 2.7 million times each year, and only 
785,000 of these usages include reading reports. Since most people 
who read RIE reports read more than one, this would involve a 
fraction of, 785,000 people each year. Less than 30 percent of ele- 
mentary- school teachers, principals, and librarians have ever used 
ERIC and many of those have used the abstract service, rather 
than reading reports available through the Research in Education 
(RIE) series.^^ 

In this and other testimony, the PA VAC Chair and PRB Chair 
both showed very limited understanding of the ERIC system, and 
particularly its availability across the country. For example. Dr. 
Combs, the PRB Chair, stated that she believed ERIC's availability 
in Winston-Salem, North Carolina, where she had been a teacher, 
was typical nationwide. This is not the case. First, Winston-Salem 
is extremely atypical in size; it is larger than 99 percent of the 
towns and cities in the country.^e The PRB Chair had drastically 
underestimated the size of the city, which is 130,000, not the 50,000 
she estimated.^'' However, even a city of 50,000 is larger than 98 
percent of American cities and towns.^s More importantly, seven 
colleges .and universities are located in Winston-Salem, and it is 
therefore much more likely to. have access to ERIC than the many 
towns and cities that do not have even one college or university.^^ 

At the hearing, the PA VAC Chair was unable to answer several 
questions about the availability of ERIG«° After researching the 
subject of ERIC availability, she wrote to the subcommittee that 
ERIC would soon be. available to any library with an IBM personal 
computer. She described this -arrangement as "providing the small 
. public library with inexpensive unlimited access to ERIC." ^.^ How- 
ever, the computer access she described is neither unlimited nor in- 
expensive: It is hot unlimited because this resource will only in- 
clude, the titles and brief summaries of documents available in the 
Research in_Education (RIE). series, not the entire report. So, any 
teacher or. administrator who actually wants to read the teaching, 
manual or research results will still have to order it from the ERIC 
system or one of the relatively few libraries that subscribes to RIE. 
Secondly, . in addition to the approximately $4,000 necessary to buy 
the disk player, IBM compatible computer, printer, and software, 
the ERIC access that.the PA VAC Chair described requires a laser 
disk that costs $1,750. for 1983-86, and will cost more for disks for 
the years prior to 1983 and after 1986.02 

The Director of the Northwest Regional Educational Laboratory 
also stated that PAVAC severely restricted the laboratories' use of 
newsletters, which were intended as an inexpensive way to make 
information available to a well targeted audience of educators and 
administrators as quickly and easily as possible. . . 
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Similarly, the incoming president of the American Educational 

Research Association, Dr. Lauren Resnick, testified that PA VAC 

recommended that research reports should be included as items in 

newsletters, rather than be available as separate reports. She 

stated that ''This demonstrated in the cases that we have been able 

to study, a clear lack of knowledge about now research findings are 

weircommunicated to users and particularly to practitioners in the 
field." 63 , , 

The PA VAC members' lack of experience in educational research 
and teaching meant that they were ill equipped to make decisions 
about the best ways to disseminate educational information. 

6. PRB MEMBERS ALSO LACK EXPERTISE TO REVIEVV^ THE MERITS OF AND 
DISSEMINATION STRATEGIES FOR PUBLICATIONS IN EDUCATIONAL RE- 
SEARCH AND CURRICULUM 

The membership of PRB represents an improvement in terms of 
expertise, at least to the extent that permanent and rotating mem- 
bers are career employees, who are working in the progremi offices 
whose products are under review. However, there is considerable 
overlap between the political appointees who are permanent mem- 
bers of PRB and those who were PAVAC members, so that much of 
the leadership remains the same. The Vice Chair of PAVAC 
became Chair of PRE, but left that position in August 1986. The 
two new permanent members of PRB, one of whom is now Acting 
Chair of PRB, have expertise in financial management, public rela- 
tions, and other administrative skills. Their graduate degrees are 
in Educational • Administration/Business Government Relations 
and Public Administration. According to the information provided 
by the Department, they have no expertise in teaching or in the 
substantive areas that the PRB will review. In addition, the best 
qualified of the PAVAC members, the Assistant Secretary for 
OERI, is not a member of PRB. 

The credentials of the PRS staiff member, who was also the 
PAVAC staff member, is also relevant, although his exact role is 
unclear. He described his P A VAM position as making information 
available to PAVAC so "they can deliberate among themselves and 
make the decision," but the PAVAC Chair stated that the PA VAM 
staff person made recommendations and PAVAC agreed with his 
recommendations 95 percent of the time.^^ In addition, he is em- 
powered to review products costing under $2,500, and products that 
had been approved by PAVAC in previous years, although he ap- 
parently did not always do so. Although this career employee has a 
doctorate in education, his most relevant substantive educationed 
background was as a math teacher approximately 20 years ago. Ac- 
cording to the documents provided by the Department, much of his 
educational expertise was related to publishing and administration, 
. not to educational research or teaching techniques.^^ 
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7, PAVAC HAS UMITED educators' ACCESS TO EDUCATIONAL EQUITY 
MATERIALS, INCLUDING PRODUCTS THAT WERE STRONGLY ENDORSED 
BY EXPERTS IN THE HELD AND BY THE WEEA OPnCE 

Prior to PAVAC, the WEEA Office approved an average of 75 
percent of the products that were proposed by WEEA grantees,^ ^ 
The proportion of approved products decreased dramatically after 
PAVAC became involved in the review process, despite the fact 
that the pre-PAVAC WEEA reviews were conducted by experts in 
the field of educational equity who used many of the same criteria 
as those delineated in the PAVAC directive. 

In the spring of 1983, summaries of 16 publications and 2 audio- 
visual products developed by MO WEEA projects were submitted to 
PAVAC,, for review. Only 5 (28 percent) of those products were ap- 
proved, and four of those were components of a single project. For 
FY 1984, the products of 9 WEEA projects were submitted to 
PAVAC for review. The products of only three (33 percent) of the 
projects were approved, resulting in 13 products, 10 from a single 
WEEA project and 2 from another "project. This resulted in approv- 
al of 54 percent of the products WEEA submitted. In January 1985, 
10 publications from 8 WEEA projects were submitted to PAVAC; 
only two publications (20 percent) were approved.^^ 

At the subcommittee hearing, the Chair of PAVAC repeatedly 
stated that these decisions were made almost entirely on the basis 
of cost considerations, such as "photogi'aphs or unnecessary 
graphs" or the quality of paper used for the covers. g^e ex- 
plained that whether the content was considered depended on one's 
definition of content: "If content is defined as the grade of the 
paper or the number of photographs, then yes, we do look at con- 
tent in terms of cost, but not in terms of philosophy."^^ In a letter 
sent to the subcommittee, the PAVAC Chair clarified her response, 
stating that "PAVAC did not question or review the personal opin- 
ions of the authors." However, the subcommittee received evi- 
dence to the contrary, indicating that factors other than paper 
quality " were involved. The PA VAM senior staff member was 
(juoted as stating at a WEEA conference in 1985 that "anti-Admin- 
istration", content was not acceptable to PAVAC. If this is correct, 
then every WEEA project could have been considered anti-adminis- 
tration, because the administration's, lack of support for the WEEA 
Program is well established. For example, in 1983, the Vice Chair 
of PAVAC,. Charles Heatherly, testified at a Congressional hearing 
that WEEA consisted of feminists "feeding at the Federal trough,^ 
and before joining the administration he had worked on a Heritage 
Foundation report that recommended WEEA be abolished.^^ In ad- 
dition,; for the first three years of his administration. President 
Reagan's budget proposals had included no funding for WEEA. 

There' is also evidence that PAVAC sometimes succeeded in in- 
fluencing the Principal Offices to withdraw recommendations for 
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WEEA products, because of the content. In a March 29, 1983, letter 
to the Assistant Secretary for Elementary and Secondary Educa- 
tion, regarding a manuscript entitled "A Very Special Book," the 
Chair of TAVAC stated "After reviewing the document, the 
PAVAC feels that the publication produced under a grant does not 
meet the criteria for essentiality that would warrant Federal in- 
volvement and further dissemination. Therefore, it unanimously 
voted to return the manuscript to you with a special request that 
you personally, review the contents. The PAVAC feels that, upon 
reconsideration, you' might withdraw your endorsement of the re- 
quest."''^ The PAVAC Chair- contradicted herself on this issue 
saying that "PAVAC rarely sees the final document" and then 
later writing to the' subcommittee that "In cases where the manu- 
script is available, istaff feel obligated to read it and render a judg- 
ment on its essentiality * *. To the extent that my colleagues 
and I looked at the* 'content' of a jpropolsal, it was to ensure that the 
document met' the teste of essentiality, reached the intended audi- 
ence, and addressed pertinent educational issues."7^ Despite her 
earlier protestations, the memorandum emd later clarification show 
that PAVAC was not considering the paper quality or other cost 
cqn8iderations,"^but'rather the content of the product. 

According to the dociimente that the Department supplied to the 
subcommittee, PAVAC almost never questioned the graphics, 
paper^ quality, or similar publishing details regarding WEEA prod- 
ucts, although they did have such concerns about producte from 
some of the other programs.'''* 

8. PAVAC REVIEW OP WEEA PRODUCTS MAY HAVE BEEN BIASED BY 
PAVAC'S ASSUMPTION THAT THE PRODUCTS WERE NOT APPROVED BY 
THE PRINCIPAL OFFICE 

In:her sworn, testimony, the Chair of PAVAC stated that it was 
the custom of the Assistant Secretary for Elementary and Second- 
ary Education not to recommend WEEA producte for PAVAC ap- 
proval, but merely to pass oh the recommendations of the WEEA 
program office.''® These statemente are contradicted by the Assist- 
ant. Secretary in a letter to the subcommittee dated January 9, 
1986, in which he stated that his "forwarding producte to PAVAC 
indicates that the producte have been reviewed, meet the User 
review criteria and the Principal Office review criteria, emd are 
recommended for PAVAC review.**''® However, since the Assistant 
Secretary for Elementary and Secondary Education was a member 
of PAVAC in the fall of 1985, it is difficult to understand how such 
a misunderstanding could occur. 
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9. APPEAi/S fhqpahed pou weea products rejected by pa vac wehe 

BLOCKED, 80 THAT ALMOST NO APPEALS WERE CONSIDERED BY PAY AC 

When PA VAC rejects a publication or audio visual product, the 
PrinciijalOifice can appiBal the . decision by providing additional in- 
formation in support of the product. Virtually all of the PA VAC 
rejectioTjj cf; i'he prodi?cts of the educational laboratories and cen- 
ters wer*;v»::Y^pealed, and a substantial number were appealed by the 
Office of Bjlingue»l Education and Minority Languages Affairs and 
the Office of Special Education and Rehabilitative Services. In con- 
trast, only one PAVAC rejection of a WEEA product was appealed 
between 1982-85.;^'^ .V 

In their sworn testimony, the Chair of PAVAC and the PAVAM 
senior staff member claimed that WEEA had not taken advantage 
of the PAVAC appeals process in most mstances where WEEA 
products were rejected.''^® The Assistant Secretary for Elementary 
and Secondary Education' also concurred that PAVAC rejections of 
WEEA products had not been appealed.''® However, documents pro- 
vided to tHe subcommittee indicated that appeals were initiated by 
the WEEA program office, but were not forwarded to PAVAC by 
the Office of Elementary and Secondaiy Education.^® According to 
the Assistant Secretary for Elementary and Secondary Education, 
appeals were not submitted within 15 days of the PAVAC decision, 
and therefore were too late to be considered for another PAVAC 
review.® \ This could have been due to inappropriate delays in the 
WEEA program office, or in the process required to get their ap- 
peals approved through all the necessary channels before they 
could be submitted to PAVAC. However, in at least one case the 
appeal document was prepared several days before the deadline, 
but was not forwarded to PAVAC.®^ 

In addition, there is evidence that the decision not to appeal was 
made by Dr. Lawrence Davenport, Assistant Secretary for Elemen- 
tary and Secondary Education, or his staff, and was not due to any 
unintentional delays. On a routing and transmittal slip regarding 
WEEA products rejected by PAVAC, dated December 12, 1982, it is 
specified that "Dr. Davenport does not wish to appeal the deci- 
sions.'! Similarly, another document regarding PAVAC review from 
March 1983 states that "As a general rule, we are not appealing 
PAVAC decisions per Lois Bowman," who is the Deputy Assistant 
Secretary.® 3 

The only WEEA product that was rejected by PAVAC and then 
appealed was a manual developed at the University of Massachu- 
setts entitled "To Make a Difference." PAVAC reviewed this prod- 
uct in FY 1983, and concluded that the product did not meet their 
standards of "essentiality, cost effectiveness, and appropriateness 
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of material to achieve stated goals/'®* The expert panelists who 
had reviewed the product for the WEEA Publishing Center had 
stated that no similar materials were available and that there was 
a great nc^d for this product It was not until an explanation was 
requested from PAVAC by Rep. Silvio C!onte, the Congressional 
representative of the women who had developed "To Make a Differ- 
ence/' and, the ranking mino^ member of the Appropriations 
Committee and the Appropriations Subcommittee on Labor, Health 
and Human . Services, arid Education, that any action was taken. 
PAVAC reviewed the proposed publication again in August 1983, 
and upheld their decision to disapprove, but the Under Secretary 
reversed the PAVAC decision. After 10 months of perseverance on 
Rep. Corite's part, the manual was finally approved in October 
1983.8« " ' 

Given that the one successful WEEA appeal of a PAVAC deci- 
sion was the result of an appecd initiated past the 15-day time 
limit,®® the 15^y time limit on appeals does not seem a credible 
reason why FY 1985 WEEA products were not reviewed by PAVAC 
on appeal. It is also important to consider that one basis of the 
most recent appeal to PAVAC was the WEEA aimendmente of 1984, 
and the question was whether PAVAC rejectio were illegal 
under the new statute. Clearly, any 15-day limit on appeals would 
be irrelevant to a question of illegality. However, the: Dejpartment 
did not examine the issue of the statute's impact on WEEA until 
after it was brought up at the subcommittee hearing. Moreover, 
the delay between the original submission of ' the WEEA product 
and the PAVAC disapproved was often more than one year, so that 
the 15-day deadline would seem to be an arbitrary time limit. 

On the basis of these points, it is apparent that WEEA products 
that had been rejected by PAVAC were not appealed and the 15- 
day limit on appeals was not waived again for WEEA' products be- 
cause the Office of Elementmy and Secondary Education or 
PAVAC members were not supportive of WEEA appeals. 

10. REJECTION OP, WEEA PUBLICATIONS BY PAVAC OR PRE CONFLICTS 
WnW THE WEEA AME1«)MENTS OP 1984 

Because of concerns that dissemination had , been curtailed, 
WEEA was amended in 1984 to require the Department to dissemi- 
nate at a low cost all materials and programs developed under the 
Act. The House report accompanying the WE'^A 1984 amendments 
states "materials developed under WEEA should be evaluated and 
disseminated at low cdst.to ensure that the original ';itent of the 
law to make these materials widely available is carried out Only 
three new projects were published in 1983 and no new projects 
were published during the first half of 1984. This amendment ad- 
dresses that situation.^?'' 
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♦ When asked about the impact of this 1984 WEEA amendment on 
PAVAC *review of WEEA products, the Chair of PAVAC testified 
that. she was unaware of the amendment.®® This statement is dis- 
turbing in and of itself, considering that the Chair was also the As- 
sistant Secretary for Legislation and Public Affairs. In addition, 
the Vice Chair of PAVAC, who had just become Chair of PRB, and 
.the PAVAC/PRS senior staff member testified that they were both 
.unaware of the WEEA amendment and therefore no changes had 
been made in the PAVAC procedures in' response to that amend- 
ment.89 In response to a question about changes in the PAVAC 
; review of WEEA documents, the Assistant Secretary for Elementa- 
;ry and Secondary Education stated that he had forwarded the in- 
quiry to the Office of the General Counsel, However, in 1985 the 
WEEA program office, had submitted a memorandum to the Office 
of Elementary and Secondary Education, requesting a "blanket 
waiver" from PAVAC review fox WEEA documents, because of the 
1984 WEEA amendments.. This memorandum had been completely 
ignored, according to tiie Assistant Secretary for Elementary and 
Secoridaiy Education. ^.^ - - • 

The Office of the^ General Counsel sent an opinion regarding the. 
WEEA amendment to the Assistant Secretary for Elementary and 
Secondary Education and the new Chair of the PRB on March 20, 
: 1986. The Chair of PAVAC and the Assistant Secretary had writ- 
ten that they - would share this opinion vrtth the subcommittee 
when at .was ,c6mpleted.^2 -Afl^j. j,gpga^^ the docu- 

ment, the opinion was finally provided to the subcommittee in July 
1986. The memorandum from the General Counsel to the Assistant 
Secretary for Elementary and Secondary Education states that "It 
is our view that, the [current] procedures are insufficient to meet 
the requirement of the 1984 ^WEEA amendment. Though it does 
not preclude, the PRB from reviewing WEEA materials, the 1984 
WEEA amendment does require that the WEEA Office disseminate 
to the public all WEEA materials in some form * * *. Therefore, a 
process must be established to evaluate all WEEA materials and 
determine how best to make them widely, available." 

This opinion resulted in a change of procedures for review of 
WEEA documents, whereby PRB would make recommendations re- 
garding^ publication, but: the Assistant Secretary for Elementary 
and Secondary Educafibn would make the final decisions.^* Only 
two PRE decisions hx^Ye been made under the new procedures, and 
the new policy, of disseminating all products is not yet in place. 
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IL PAVAG BEVI^^ PUBUCATIONS THAT IT WAS NOT 

f '^PAVAC review is hot for any publications that cost less 

:11ian $2,500 to develop and prints Instead, PAVAM staff can ep* 
prove tlK>8e product >^ PAVAC involvement. The appar- 

ent reason is that Jt iwbiild not be cost-effective to require senior 
staff to/spend J^ cost. In 

her testimony, the PAYAC C^air stated that "Dr. Harris, in his ca- 
pad^ as the career staff, is in a position where he looks at all pub- 
' lications i: medces : a decision on his; own on 

:tho8e.W0'/^vn^.7^^ ^ ; VK:.;-,, 

•1 However, r of the 18 WEEA' products that were rejected by 
PAVAC in FY 1^^ percent) had requested 

$2,500 or less to publish. In fact, four (22 percent) would have cost 

under $1,000 each.® ^ Nevertheless, they were reviewed and rejected 

■by;PAVAC,1^S;;^v^^^:Vr^.-;;;^ ■ 

similar for the products submitted for approval 
by^^ the educational ; laboratories and centers. Of the 124 products 
that were appealed after being reviewed and rejected by PAVAC in 
FY>1985, 104 (84 percent) had required $2,500 or less to publish. In 
fact,\13 ;(13 percent) of thsJ ^3S appealed products that PAVAC re- 
jed»d would have c<^ 

^^^^^^^^ Chair of PAVAC pointed 

' out that there is hd l^al rastn^ and PAVAC can review those 
pubUcatidns if they^choose^ the 1983 PAVAC Di- 

rective that. "Those* submissions that a^^ within the $2,500 thresh- 
old and aren^ by PAVAM will be presented to PA VAC 
in the'noraal inanner.'V She^^s^ case of the large 
number , of products submitted by OERI on behalf of the education- 
al lalx)rai»riM and, ^ that all such products 
should be considered by t^^^^ an effort to provide the 
PAVAC with ah overaU; perspective and the opportunity to act in a 
consistent, ^iiitabte manner."®® 

However,'- these pf o<^ not consistent with procedures 

used for the products proposed by the Office of Bilingual Education 
and Minority limguj^es Afifairs or! t Special Education 

and RehabiUtatiye Services. For both of those programs, all prod- 
ucts ■ costing under $2,500 were reviewed and, approved by 
PAVAM.®». The PAVAC Cliair did not give an explanation for the 
^WEEA reviews, so it is unclear whether PA VAM did not approve 
th^, or PAVAC decided to review them all for another reason. : 
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12.y PAVAC. REVIEW UNCEIltAINTy THAT DE- 

CREIASED THE EFFECTIVENESS OF THE EDUCATIONAL LABORATORIES 
^ VAND CENTERS m.: 1985, AND, PRE iIS HAVmc : A SIMILAR IMPACT IN 

;;^;i98[6v,.:^ - ■. 

TKe educ» were first notified of 

the need : for PAVAG approval on November 30,; 1984. Within a 
month," most laboratories had requested PAV approval. On Jan- 
uaiy 23, 1985, the laboratories received a memorandum from NIE, 
which ^included forms that the laboratories heeded to comj^lete for 
the PAVAC review. In February 'and March/ the laboratories com- 
pleted and sent'the fonns that were reqim for PAVAC review, as 
weU'fas^i additional;/: information thati-was requested. In April, 
PAVAC rejected ^NBE s requ^t for blanket approval for all these 
products^ ; and NlEirequested more information from the laborato- 
ries about: the proiX)8^ 

were informally notified that only 89 of the 353 pubUcation^ were 
approved.; Appeals ; continued . until ; August, when the laboratories 
were notified that - less - than 20 percent of the appealed products 
had been approved.; Finally, on September 18, the PAVAC rejection 
decisions , were rieyersed by the and all 98 publica- 

tions that had bi^n appealed were approved. . 

This chronology indicates that the PAVAC process took almost 
10 months. The number of propceed pubUcatibns dropped dramat 
cally, for a variety of reiasons. In wme^c^ the number of copies 
was dropped below 50, so. that PAVAC review was no longei* neces- 
sary. In other cases, the delay was no 
longer timdy; . for example, it msJces no seibe to print the winter, 
spring, 'and summer newsletters for distribution in October, or to 
publish a manual intended for use at ft conference that was held 
threa months earlier. In those cases, the laboratories and centers 
were unable to di£fseminate information , that they had determined 
was important^ This determination was not motivated by financial 
benefits, since the labofatoJries (not the Federal Government) were 
able to keep moneys , that had been set aside for publications if the 
piiblicatiohs were not appfoved.^^^^^/^ ^^^^^^^^^^^^^ ^^^^^^^^ 

The PRB process hias already meant a nine-month delay for the 
products of the -educational laboratories and centers. As of August 
1986, the educational laboratories and centera had not yet received 
iipfKrpyal for any of the products that they submitt^ to PRB for 
review.^° ^ In one case, a publication that was not intended for PRB 
review, because less than 50 copies were planned; was reviewed by 
PRB anyway. As a result, the laboratory was required to print 
more thah. SO copies, and to use the Grovemment Printing Omce. 
This- will create unnecessary delays, in the dissemination of that 

:pubIication;f°2.^-:.-.,:^,; .•^■■•...-..v . ''''-^^ \ .". 

r TO possible by 

: finding alternate sources of funding for newsletters and other prod- 
ucte t&t have to be published before the reviews are completed. In 

Heariitf^, tMtimony of Dr. Rath^^ 
: ; Letter from Joseph Schneider, EScecutive Director of Council for Educational Development 
/and Research, to ike Honorable Ted Weiss, Sept 9, 1986, , in subcommittee files. According to a 
conversation with Mr. Schneider, only one product was reviewed by PRB by the end of August. 
. In subcommittee files. , 



ivif ^dition^thei^P^ :]liad a chiUihg^ef^^ 
%!^%^m 1986; ^the ^^1^ oentejre'apps^^ 

|^-Hi^(Kiiu^ in ttie?^.nuni^ P^p- f 

^•^i;i?pos^^ VfiBS predict^ iby ^^t^^^ ' 
^i^vdentille^ 

p; her thv^ confront the bureaif 

gfecfatic.ht^ schbl:- 

J;^}J^i?ara m ai^ not^iBntail addir- 
^j^ : tional i gorornment; : controls - and rcquirenieiite.^ 
f^f;^- overly^ sensitive to, , what the. edend . govepment majr- approve or 

tv^^^^dirapprpTC -avoid' a)htro rese€axhT;topi<» aiid, problems. 

In fi^^ ; 

.^l^ r-jars may^ or perceived crite- 
g|^vria of acc2p{^ility.*°* Tha 

communities^ because^ l about successfiil, teaching 

i{:J;';';tech^^ " 

V /^^^ from the educational Ifidw 

v^.!;:^tories; any 

3^@v money, because- the-mbriey ■ wm by the; laboratories and cen- 

^^gtera^^liyfbe^ i PRB <;regect ;WEEA^ publications, the 

c V ainbim a : wnall : ft•action^ of : 

• ; the oM ajsmall^itt^portion of the 

>i|lt)^mon^fspent^bri tfo the: product or 

|:KJ;;pi^ucta:I^ of money brought in by sales of i 

^5:^ - W ixi^feoMrt iye^ anumnt 

spent . to pub ' ^- ^ 

^5;j:^^i;AU;ttte been judged to be 

tiinelj^:^^^ Officers with 
if V^S substfimtivejexpi^ 

t^iS; that the PAVAC criteria of -"m^ most often 

I feusedias a^ justifi^ not a 

^fei^ ' claim that . t^^ little br ho y£dub.vlt;is therefore of par- 

^l^^i^ ticiilar ihtei^tit^ a considerable 

^un items." This could 

ll^f^perhajps hir^e beeng were ofPerislve or of no 

: - value. LoL-thfiA^ throwing good money 

Jffv^f^after ;bad.' ■ that the products had 

|i^i^ridjyalue,Nbutcr£^ not essential^to ;the' Depart^ 

■$§^iment=-fulfillihgiits^miM s ''-^"^-"'i^ -^^v /'':;b/7^.^ '.^ii^ii>' . :'-<y- 

:2. /raK^^^ IS DUPUCATiyE AND Tlffi 

jiM^ IS abjSORSHIP,(OT EDUCATIONAi; MATERIAL '\ 

Educatibn DiepartmentvDocuments A:MK 
|g|?:110/^hicH describes PRB, the review, process that cul- 

pl^l mina several; layers of re^ 

Hearing, testimony, of Dr; Resnick, prepared statement; pp. 
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r ' Vviewera?wK 'The ifinal layers of review, 

?i : Pi^^ staffs 
;; Vv^|;^a^ involvecl, al- 

J^v;?;ij:^t^^^ to publish- 

K^5:;^:;iHg^^ kinds of 

v^'^^^^^v* M eiasCTitiality £uid 

''':::r-:iwielmesi^ ' .-^v-- 

^^^^l^i ' 16^^^ of a 

irtf . J^K^ product - without iti the program will not 

fulfill its mission'/ Even the PAV AC CKair agreed that iio one prod- 
uct coiild eyeir be that' iiniwitant, iahd she was to: define the 

:/;;Vteim;iri'ar^ 

:--^Timeliriess is: a criteiibh ^ often- used & basis for rejection by ■ 
:; PAVAC;} in FY;^ ^W^EA^^ that were r^ected 

: were on the basis of essentiality and timeliness.^°T However, time- 
Uhess is not included in : the description 'of PAV AC. or, PRB crite- 

:Kbv noted that 

- gran^ tliat areVoinsidei:^ and 

: :iS ^^t^ 

; V therg^^ did ■ 

' h6t;: ag^^ 

between timie that the v 

;^^^^prqject;isic^ 

V 

;\ ; -^^;C8tafl^ a^ 

;;;V^^ix)fgrants|awa^ ■ yt-: ^lyy■^^:■ 

T/(^^;yi^^n^ yp&ier ahd content-related^ critena • ar ded- 

v^^^^^^when- the do€Uinents:and- static con- 
tradid ■ sworirv testitbony there >is vi a :c ^ sugg^tion that tHe 
review proceai iis te limit di^iziination of ' information, 

, regiwdless of the; 

f According to ttie K of the American Educational Re- 

■ search 'A a 
learning TesearchVcehterr VPAyAC s role in deciding whether or 
: - ' not pubUcations :sh6uld be^^ serious threat to the 

U integrity^of the-rescMch an Feder- 
al tGoyermrient^turM assistauace be- 
cause>of:!^t^^ and expertise, 
; MdvtKeirJindepe the 
i . Federal Goyeniment mu^^ exercise restraint i in seeking ; 
rx>^" : control dveroreseafch^c^ must provide adequate; ; 
4 guarahteeSV safeg^ and assurances gainst - it- ' She warned 
/; that; wgafdleM "an attack 

^;: The Directive des(^bins PRB iias the same number as the one describinj; PAVAC, but is 
... entitled Publication ahd'Audiovisual Review System (PARS) and dated Nov. 57l986. ' " 
Hearing, Graham testimony, pp. 91-2. • 
"'In subcoihmittee files/ v^/.^^^^^^ ^ ^ r .^ 
Hearing, Graham teetimony, p. 92, , v *: . : . . • • ; ^ ' ' ' '^i " 

; '. . Hearing, testimony of Dr. Resnick, p.' 118. v / ' ; ^ ' - • * 
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iB.^Tim fROM PAVAC REVnW ARE DUE .JN LARGE 

■• :ii-PART;TO^^^ MADE .BY ra . NOT 

REDiS^noN ACT OR omb/ r ^: : i , i ; , r 

;^;^^In; many insiiances," ' beyond vthe staiiiiards 

•set: fiyVOBfe.^^ in a niebap^^ fo Assistant Secre- 

tly and the b£fice''of the^^^ 

<j "under 'ourl'Xe^ld^^ autHbrity; Sec. 405(eXl), almoi3l;:'Werythi^ 
.fprodiic^ (pubUcatipns a^ audioyisuals) is a result ; of a NIE re- 

¥searchix 

; of I^OWDB did| not respond te; 

•:::vthiEit'miemorahdum^5^ r- r] ^.^/y^/^ :v . ■ 'C.^ ^,Cl.^'.y^'<i, 1- v • 

<; vi^vlri:i additibn^t^^ is^;e3rtreme^^^ loose; 

g PAyAC; J rerw^ thie; 
itintJeitt c6pie8.JThe^ 

^^the;samiB;me^ 

?(reyis^ acciirately^define' I opposed . to' diiplica- 

^^^tibp.!;4 A^ heanng, Rep^ 

i^cai^ : of ; research that 

=;j.*cbmdn?t^genera ids^ym jX^ 

^hine^>^. ; :-^Gbve^^ with any- 

;^5iliing thatiKa^ shoidd ttiie Congress."* 

>;And yet,;i;50 or m^^ 

s"PAyAG;reyiew^pr6<^^ be reviewed by PRB. ;- - 

PAV^ npt required f^^^ costing under 

$2,500, and yet accord the Department 

:';suppUed; to t^^ majority, of WEEA and educa- 

i: tional ) laboratories " and ' centers • products * reviewed cost under 
:-'^!2,500.feo'':;;v^^^^ . \ . 

|>^;^The-:final pb ''timeliness'^^'was' not;ja^cfiterion for 

1^ PAVAC ?;-reaefeti6h, even in the Departrnirai/^^ ^procedure 
5;ih£uiual^^^^i^ used as at basis of rejection for WEEA 

i prbductB^t a^ ^metipies for the products of. the educational' labora- 
:^tpna3'-£md/cent^ ^- ' >' '^^ . 

■ ?^4l^T^ TOAT 'has REPIACED PAVACJ, OHE: PUBUCAr 

^^ .^TIONj^iftEi^^ MANY OP.r.THE^ SA^ffi • 

V';^ PR0BI^M8''AS' i^^^ ; ' ' ■ \. ■. ^^ ■."^^5>';*^.< -V M. - • -V / ' • l\ - . ' 

"^TKere are fe 

Xl: Re^^ PRB review, but'the^defi- 
nitibh of reisef^ left up tb'each Assistant Scks^re the sub- 
committee hei^ the Chair of 
7theiPBB^,waisfwi^ research would be defined. 
^ :Nine mbn^ not have an ap- 
;^prb\^'definiti^ ! ■ 
vv^^^r^^^g^ ^ . ■ ■ : 

' •v ^M9.M Pn)gram'.Cc>ord^ Saira Bass, 

i . ' Office of the Under.Secretaryy AiuT' 18, 1986; in subcommittee fUes-vi ; • : }, • • ■ , - . . u - 

V- * " Heariog, testimony of the Honorable Jfthn Grotberg, p: 96. - : - . . ' . ; : , 

^0^}}* In September 1986,- 10 months after PRB was created, OERI approved a definition of re- 
sS'- Bwurch. Approximately 80 products were,ex;&npted front PRB review, as a result of this defini- 
tion; detailed information was not yet available to the .subcommittee at the time this report was 



?^rA^i : f2;/ M has been modified to inclu^ several 

• V ; ^ program a fotatihg baisis/ but individuals with substantive 

' 1 expertise are; stiU^^utnumbered'b appointees and career 

stSff who.are not lm the substantive area. 

= ^v^^^^^ app^i the Principal Officer can appeal, 

'-te^^^ the Under 

S^fetary^for^M to be the iChair/of the 

. the' Department's, f art : 

fs!;/;^;sheeti3Hull^^ staff was 

^gS^identica^to^h^^ -vy ^; : r . : ■ ' 

^ to those pf 

EAVAC^j^^ One of the cnte-. 

. Cr^ ■ nra^ be;used to censor 

the tK>Utical^'appbintees^ or: 
V'^^VCMeer members mPR^ . ^a^^v " "^^-' '^A'^ 

^ ; ^iAiS jDf early the j^uc^ lalK)ratories iemd ^centers ' liail^ 
i' : ; stiU?n6r 

■ ; ; any^ortKe^^^^^^ they subimtted.' problem : of : lengthy ' 

delays ^that re^ year, and the ihheren^^^ inef- ; 

ficiences that J'l^Mt, have continue und^r ; PRB'review p 

; :-V'^In^ additidh^^'there ; is ;e that ''PRB^- is "review 

Lthat' it is^iw^ as PAVAG did::This caus^ eveii' 

i more dela^ in^M^ ^^^X-li;; • v • 

vt^^i: i4 ;V^^ WEEA ^"products 

ciahhot^yetv^be assesaedZ-becaiisie •:b^ 

^'■■•■.\:be€^-re 

j THE KINDS OP COST-CUTTINb - 

J AND NUMBERS OF; COPIES. 

^ ^ i H v Th V P 

^ /expertise: Offices fegiarding publishing and; prodiic-' 

jv/ : m^^ sindio : visual products. This teclmical^^assistenre in addition to a 
y;r^^^part^ apprig^ expenmw relations 

5:^7-::prc3iMi^ 

:H : However; judgments regarding quality and essentiality of the piibli- 
^^J"^ vcati6n%^and audibr be jmade by; the Program 

/ o pf the Piina^ \ 

HEFrimi by'gepa^^from piua 

' i W Act (GEPA) defines educatiori- 

* : i al ^reseOTch^ asV,;*!^ - and :^ applied), vplanning,n surveys^ ^ 

; ; eveduations, investigations, experimente 
v V: stiBtions 

i^i .) ■ ; ^ th intent|;of;PB® review the cost-efGectiv^ 

■ V- , semma^^ it shoidd be ;us^ to review^ public infor- 

: V' 0^^' The PRB^p is desCTibed in a farf sheet in 'subwmmittee files. ' ^ ' V ■ ' : 

•;i V ;^:-*** In subcommittee fUes.^ ■•. • v / , ,r ♦^^ 

^ Sec. SOUaXe), June 23, 1972. 86 Stat 330, in subcommittee files. ' ^ ' 
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;^'Ination^ bnxrhxires. and;, other generad i^^ Re- 
. search-relatcni pubUcatioiiB require re^^ who are more knowl- 
edgeable cdK)utresearch| statistic^^ and the content area involved. 
:; Rccluding materials that fall^'uhder ^ the GEPA definition of re- 
i : search ^^^w^ 0MB as well as the 

• :mandate^^^ as described by the PAVAC Chair;iIt is more ap- 
/ propriate^to use'a single defim of research^ rather than requir- 
'iiiqi; each Asfidstant or Under Secretary to define it for an 

/-.individual' program.:^ /.v,;,;;.;/,.:::-:';: ■ : 

' ;Uri^ virtually cdl products of the educa- 

tional lsJx)ratories£bdcen^ many of tfie WEEA products; and a 
{ minority of products from Bilingual Education and Special Educa- 
tion would exempt fro 

• \ ; i , 3. EUMINATE WEEA 

Since WEEA is mandate disseminate all its products at low 
cost, and since it has a. publishing center that uses Department ap- 
proved pricing gxddelines that are based on the Government Print- 
ing CHficeregulatioi^ is no need for PRB review. The last 
tfaiee years have clearly shovm that PAVAC review resulted in the 
censorsWp of WEEA niaterials^ a^ the PA VAG Chair and 
PRB Chair werig ignorant of the law regarding WEEA's mandate. 
In' addition/ the procedures the last few years have result- 
ed in a 'coiisiderableamou^ of confusion and neglect regarding 

. submissions and appeals/ with no ^office taking responsib&ty for 
the problems that have prevented :WEEA products from being dis- 
seminated. Therefore, the responsibility for the dissemination of 

' W JfiEA products should be returned to the Principal Office. 

: As stated previously, most of the WEEA products originated 

' fix>m educational research or evaluatio Tms is an additional 
reason why they should be excluded from PRB review. 

4. WEEA PRODUCm THAT WE3^ AFTER THE WEEA 

AMENDMENTS OF 1984 SHOULD BE WIDELY DISSEMINATED 

that were rejected by PAVAC after the 1984 
WEEA amendments became law were not: widely disseminated, 
athoi^h dissemination was^required by law. The failure to dissemi- 

j nate those materials was illegal, and, despite the delay, thero is 

^ evidence that they would attract a wide audience. 

^-.^ of these products has been substantiated by the 

increased sales of WEEA products th^ the first nine 

EQOnths , of FY 1986; sales of WEEA products reached $123,723, 

•which surpassed the total annual sales of any previous year. This 
figiire isjMpeciaUy nbtewor^^ considering that only two new prod- 

•^ ucts were available within the last two years. In fact, materials 
that were fiiBt published in 1979 are still being requested and pur- 
chased for teachers and administrators at all educational levels.^^® 



In subcommittee files. 



5. DECISIONS 'ABOUT EWC AS AN OPllON f6^ DISSEMINATION SHOUU) BE 

^^Tlie testimony of and PRB Chair indicated 
"that they , were mot- knowledgeable a^ of ERIC, 

:and3werei;inaking ; decisions about dissemination in ERIC on the 
basis of. inaccurate Information and assumptions. Given -educators' 
limited use! of reports available through ERIC in recent years, and 
the PRB members': limited expertise regarding ERIC, decisions re- 
garding use of ERIC as a means of dissemination should be made 
by. the P^ogrami .Offices. They are most knowledgeable, about the in- 
tended iaudieiiceof the; product, i they have negotiated the terms of 
the grant or contract that led ;to the product, and they are fully 
qualMed to submit any materials to ERIC without assistance from 
•PRB.:--..:;:;:\^.y,; ■ v y,:>V- _ ; 

6. EUMINATE PHOTOCOPIES AND PRODUCTS COSTING UNDER $2,500 
' ^ ^ ' ' ^ ■ ; FROM PRS AND PRB REVIEW 

Decisions made about the less expensive methods of product dis- 
semination, such as offset and photocopies, should be made by the 
Program Office. Reviews of products costing $2,500 or less should 
be made by the. Program Office and the Principal Office, unless the 
Assistant Secretary or Under Secretary requests assistance from 
PRB or PRS. These procedures are more costeffective, and there is 
no reason to believe that the PRS is better qualified to make these 
(tecisions than the Assistant Secretary or Under Secretary respon- 
sible for the Principal Office. 



DISSENTmG' S. WALKER, HON. 
" iF^^ WILLIAM P. CLINGER, JR„ HON. 

ALFRED vA:^ (AL) • McGANDLESS,^ HON^ LARRY E; CRAIG, 
¥ HON?HOWARD C; NffiLSON, HON. SAXTON; HON. PAT- 
RiGK L.^SWI^ D. (TOM) DeLAY, HON. 

■ laCHARD K. ARMEY, HON. JIM LIGHTFOOT, AND ;HON. 
"■^^.j^r^^'BO^^ v;;- : ■■■■^ : ■ ; ' - 

. i;v/^^ probiems with 

>&e5pubUcations review pr at the DepEuitment of Education. A 
number. of questions -are also raised about the costeffectiveness of 
the pro<»durei.iWe believe these pro^^^ been 
or iiwU vbe addi^^ because of the 

manner in which this issue was hancUed, /as evidenced by the title 
• of the report^ ' ^^^ 

: :^Tbe centerpiece of thfa report— a Department of 
:: E^^ absurd on its face 

and ridiculous in its impUc^^ of hearsay and in- 

nuendo, the authors Vconclude that decisions of the Department's 
V Ihiblicatidhs and Audio^ual. Advisory Council (PAVAC) are politi- 
vcaUy and phdlosopWc^ have no evidence to sub- 

I'stantiate that theory because there is no way that such a theory 
can be siibstahtiated. 

:/There^^ prohibition against the private funding of 

tlie printing and dissemination of educational materials^ nor. 
f^ iagainst the printing and d^ 50 copies of 

■ any ' Single item. Consequently, the charge of censorship is com- 
pletely unfounded and toteJly irre^ 

: ROBEOT 

Frank Horton. 

: WHiUAM P. CUNGER. 

Al McCandless. 
Larry E. Craig. 
Howard C. NiELSON. 
, Jim Saxton. 

Patrick L. Swindall. 
Tom DeLay. 
Dick Armey. 
Jim LiGHTFOOT. 
Beau Boulter. 
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^#^Mi^^Sl^ OF HON^TED WEISS ^ ^ 

> report ; p^^^ Bubstantial evidence of systematic, bias 

y, against vpari^icularyt publications, especially 

those^ funded through the Women's Educational Equity Act and the 
: Nationial: Instil^ ■ . :^ ^ : * " 

: dissent claims that denying approval to publish the 

products^^of Fede research and projects is riot censor- 

■ ship' but^lgoi^ when, as documented in the 

repoirti ' there -wiU be a^^ no savings to the Federal govern- 

ment. W^ who have received Federal grants or 

contracts vto develop >these materials iare not allowed to use the 
funding'that ; has ; already been set aside for publication arid dis- 
semination, the conclusion is inescapable that the Department 
simply does not like the findings of the research or the goals of the 
•cumculal':^]: •'■'■-■-^ 

Ted Weiss. 

(32) 



